Although frozen in time by planning controls, it is difficult to imagine the need to expand a property like Kensington Palace Gardens.